Statistically Motivated 3D Faces Reconstruction
نویسنده
چکیده
Facial surgeons require a vast amount of knowledge about the human face, in order to decide how to reconstruct an injured or traumatized part. Does this knowledge consist only of explicit notions about face anatomy, or is there also an implicit knowledge of the normal appearance of a face? And if the answer to the latter question is affirmative, is there a way for a computer to automatically learn this implicit knowledge and exploit it to predict the optimal reconstruction of part of a face? A set of examples of human faces, acquired as 3D surfaces, can be used to build a statistical model, which can generate synthetic faces or analyze novel ones. Such a model is also able to reconstruct the missing part of a face in a statistically meaningful way: any face which can be generated by such a model has a certain probability, and the optimal reconstruction can be defined as the one which maximizes it, given the available data. However, since the model is built from a finite set of examples, it cannot generate any possible face, and therefore the purely statistical reconstruction will not perfectly fit the available data, leading to discontinuities at the boundary between the missing and the available data. In order to avoid this, we look for the surface that explicitly satisfies the continuity constraints at the boundary, and at the same time approximates the first derivatives of the statistical prediction. This leads to a partial differential equation, which can be solved numerically as a linear system. As an example, we show how this method performs reconstructing the noses of a set of test faces.
منابع مشابه
Extreme 3D Face Reconstruction: Seeing Through Occlusions
Existing single view, 3D face reconstruction methods can produce beautifully detailed 3D results, but typically only for near frontal, unobstructed viewpoints. We describe a system designed to provide detailed 3D reconstructions of faces viewed under extreme conditions, out of plane rotations, and occlusions. Motivated by the concept of bump mapping, we propose a layered approach which decouple...
متن کاملProgressive reconstruction of 3D objects from a single free-hand line drawing
This paper presents a progressive algorithm by which we can narrow down the searching domain for face identification and reconstruct various 3D objects from a single freehand line sketch drawing in short time. The sketch drawings served as an input for the reconstruction process in this paper are obtained from an inaccurate freehand sketch of a 3D wireframe object, which is the edge–vertex grap...
متن کاملImage Based 3D Face Reconstruction: a Survey
The use of 3D data in face image processing applications has received considerable attention during the last few years. A major issue for the implementation of 3D face processing systems is the accurate and real time acquisition of 3D faces using low cost equipment. In this paper we provide a survey of 3D reconstruction methods used for generating the 3D appearance of a face using either a sing...
متن کاملEfficient 3D reconstruction for face recognition
Face recognition with variant pose, illumination and expression (PIE) is a challenging problem. In this paper, we propose an analysis-by-synthesis framework for face recognition with variant PIE. First, an efficient 2D-to-3D integrated face reconstruction approach is introduced to reconstruct a personalized 3D face model from a single frontal face image with neutral expression and normal illumi...
متن کامل